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Abstract 

The paper considers the problem of robust estimating a periodic 
function in a continuous time regression model with dependent dis- 
turbances given by a general square integrable semimartingale with 
unknown distribution. An example of such a noise is non-gaussian 
Ornstein-Uhlenbeck process with the Levy process subordinator, which 
is used to model the financial Black-Scholes type markets with jumps. 
An adaptive model selection procedure, based on the weighted least 
square estimates, is proposed. Under general moment conditions on 
the noise distribution, sharp non-asymptotic oracle inequalities for the 
robust risks have been derived and the robust efficiency of the model 
selection procedure has been shown. 
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1 Introduction 



Consider a regression model in continuous time 

dy t = S(t)dt + d& , 0<t<n, (1.1) 

where S is an unknown 1-periodic K — > R function, S* G £ 2 [0>l]j 
(£t)t>o ^ s an vmobservable semimartingale noise with the values in the 
Skorokhod space V[0,n] such that, for any function / from £ 2 [0,n], 
the stochastic integral 

/•n 

W) = / fsdHs (1-2) 
is well defined and has the following properties 

pn 

E Q J n (/) = and B Q I 2 n (f)<a Q fids . (1.3) 

Here Eg denotes the expectation with respect to the distribution Q 
in D[0, n] of the process (£,t)o<t<m which is assumed to belong to 
some probability family Q n specified below; aq > is some positive 
constant depending on the distribution Q. 

The problem is to estimate the unknown function S in the model 
(II. ip on the basis of observations (yt)o<t< n - 

The class of the disturbances £ satisfying conditions (II. 3p is rather 
wide and comprises, in particular, the Levy processes which are used 
in different important problems (see [3], for details). The models (jl.ll) 
with the Levy's type noise naturally arise (see [18J) in the nonparamet- 
ric functional statistics problems (see, for example, [8]). Moreover, as 
is shown in Section [21 Non-Gaussian Ornstein-Uhlenbeck-based mod- 
els also enter this class. The latter models are successfully used to 
model the Black-Scholes type financial markets with jumps (see [2], 
|6j for details and other references). 

We define the error of an estimate S (any real-valued function 
measurable with respect to cr{y t , < t < n}) for S by its integral 
quadratic risk 

K Q (S,S):=B Q:S \\S-Sf, (1.4) 

where Eg s stands for the expectation with respect to the distribution 
Pq 5 of the process (ll.ip with a fixed distribution Q of the noise 
(£t)o<t<n an d a given function 5; || • || is the norm in L 2 [0, 1], i.e. 

||/|| 2 := f f{t)dt. (1.5) 
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Since in our case the noise distribution Q is unknown, it seems natural 
to measure the quality of an estimate S by the robust risk defined as 

K(S,S)= sup K Q (S,S) (1.6) 
QeS„ 

which assumes taking supremum of the error (|1.4|) over the whole 
family of admissible distributions Q n . 

It is natural to treat the stated problem with respect to the quadratic 
risk from the standpoint of the model selection approach. It will be 
noted that the origin of this method goes back to early seventies with 
the pioneering papers by Akaike [1] and Mallows |21| who proposed 
to introduce penalizing in a log-likelihood type criterion. The further 
progress has been made by Barron, Birge and Massart [3], [22], who 
developed a non-asymptotic model selection method which enables 
one to derive non-asymptotic oracle inequalities for nonparametric 
regression models with the i.i.d. gaussian disturbances. An oracle 
inequality yields the upper bound for the estimate risk via the min- 
imal risk corresponding to a chosen family of estimates. Galtchouk 
and Pergamenshchikov [9] applied the Barron-Birge-Massart technic 
to the problem of estimating a nonparametric drift function in ergodic 
diffusion processes. Fourdrinier and Pergamenshchikov [7] extended 
the Barron-Birge-Massart method to the models with the spherically 
symmetric dependent observations. They proposed a model selection 
procedure based on the improved least squares estimates. Lately, the 
authors [17J applied this method to the nonparametric problem of es- 
timating a periodic function in a model with a gaussian colored noise 
in continuous time. In all cited papers, the non-asymptotic oracle 
inequalities have been derived, which enable one to establish the opti- 
mal convergence rate for the minimax risks. In addition to the optimal 
convergence rate, the other important problem is that of the efficiency 
of adaptive estimation procedures. In order to examine the efficiency 
property of a procedure one has to obtain the sharp oracle inequalities, 
i.e. such in which the factor at the principal term in the right-hand 
of the inequality is close to unity. 

The first result on sharp inequalities is most likely due to Kneip 
[15] who studied a gaussian regression model. It will be observed 
that the derivation of oracle inequalities usually rests upon the fact 
that the initial model, by applying the Fourier transformation, is re- 
duced to the gaussian model with independent observations. How- 
ever, such a transform is possible only for gaussian models with in- 
dependent homogeneous observations or for the inhomogeneous ones 
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with the known correlation characteristics. This restriction signifi- 
cantly narrows the area of application of the proposed model selection 
procedures and rules out a broad class of models including, in par- 
ticular, widely used in econometrics heteroscedastic regression mod- 
els (see, for example, [H]). For constructing adaptive procedures in 
the case of inhomogeneous observations one needs to modify the ap- 
proach to the estimation problem. Galtchouk and Pergamenshchikov 
|11|-|12| have developed a new estimation method intended for the 
heteroscedastic regression models in discrete time. The heart of this 
method is to combine the Barron-Birge-Massart non-asymptotic pe- 
nalization method [3] and the Pinsker weighted least square method 
minimizing the asymptotic risk (see, for example, [23], [24] ). This 
yields a significant improvement in the performance of the procedure 
(see numerical example in 

The goal of this paper is to develop the robust efficient model 
selection method for the model (11. ip with dependent disturbances 
having unknown distribution. We follow the approach, proposed by 
Galtchouk and Pergamenshchikov in in the construction of the 
procedure. Unfortunately, their method of obtaining the oracle in- 
equalities is essentially based on the independence of observations and 
can not be applied here. The paper proposes the new analytical tools 
which allow one to obtain the sharp non-asymptotic oracle inequal- 
ities for robust risks under general conditions on the distribution of 
the noise in the model (jl.ip . This method enables us to treat both 
the cases of dependent and independent observations from the same 
standpoint, does not assume the knowledge of the noise distribution 
and leads to the efficient estimation procedure with respect to the risk 
(jl.6p . The validity of the conditions imposed on the noise in the equa- 
tion (jl.ip is verified for a non-gaussian Ornstein-Uhlenbeck process 
(see Section [2]). 

The rest of the paper is organized as follows. In Section [3] we con- 
struct the model selection procedure on the basis of weighted least 
squares estimates and state the main results in the form of oracle in- 
equalities for the quadratic risk (jl.4j) and the robust risk (jl.6p . Here we 
specify also the set of admissible weight sequences in the model selec- 
tion procedure. In Section|4]we proof some properties of the stochastic 
integrals with respect to the non-gaussian Ornstein-Uhlenbeck process 
(12. ip . Section [5] gives the proofs of the main results. In Sections El [7] it 
is shown that the proposed model selection procedure for estimating 
S in (jl.ip is asymptotically efficient with respect to the robust risk 



4 



(jl.6p . In Appendix some auxiliary propositions are given. 



2 Non-Gaussian Ornstein-Uhlenbeck pro- 
cess 

In this section we consider an important example of the disturbances 
(£t)t>o m P-IP given by a non-gaussian Ornstein-Uhlenbeck process 
with the Levy subordinator. Such processes are used in the financial 
Black-Scholes type markets with jumps (see, for example [6] and the 
references therein). Let the noise process in (jl.ip obey the equation 

d£ t = a{; t dt + du t , £ = 0, (2.1) 

where a < 0, u t = g 1 w t + g 2 z t , Qi and g 2 are unknown constants, 
( w t)t>o * s a standard Brownian motion, (z t ) t>Q is a compound Poisson 
process defined as 

N t 
3=1 

Here (N t ) t>0 is a standard homogeneous Poisson process with un- 
known intensity A > and (1^) J>1 is an i.i.d. sequence of random 
variables with 

EK = , EY 2 = 1 and EY 4 < oo . (2.2) 

3 3 3 v ' 

Let (T) k>1 denote the arrival times of the process (N t ) t>0 , that is, 

T k = inf{t > : N t = k} . (2.3) 

We assume that the parameters A, a, g 1 and g 2 satisfy the conditions 

- a max <a<0, 0<A< \ max , g* min < g* < g* max , (2.4) 

where g* = g\ + \g\. Let Q n denote the family of all distributions of 
process (|2.ip on 2?[0,n] with the parameters a, A, g 1 and g 2 satisfying 
the conditions (12.4p with fixed bounds X max > 0, a max > 0, g* . > 
and g* > 0. 

'-max 
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3 Model selection 



This Section gives the construction of a model selection procedure for 
estimating a function S in (jl.ip on the basis of weighted least square 
estimates and states the main results. 

For estimating the unknown function S in the model (jl.ip . we ap- 
ply its Fourier expansion in the trigonometric basis (0j ) J>1 in €2$, 1] 
defined as 

01 = 1 , ^(x) = v / 2Tr j (27r[i/2]x) , j > 2 , (3.1) 

where the function Trj(x) = cos(x) for even j and Trj(x) = sin(x) for 
odd j; [x] denotes the integer part of x. The corresponding Fourier 
coefficients ^ 

e j = (S,ct> j )= [ S(t)<t>At)dt (3.2) 







can be estimated as 



1 
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4>j(t)dy t . (3.3) 







In view of (jl.ip . we obtain 



%,n = j + ^ j , n , ( j>n = ^I n (^) (3.4) 



where I n (4>j) is given in (II. 2D . 

For any sequence x = (Xj)j >1 , we set 



00 

|2 



Yj x "j and #( x ) = 1 {i^i>o}- ( 3 - 5 ) 



3 

3=1 j=i 



Now we impose some additional conditions on the distribution of the 
noise (&) t > in CCO). 

C-J There exists a positive constant ?q > such that for any n > 1 



L i,n(Q) = sup 

x£H,#(x)<n 



< 00 , 
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where U = [-1,1]°°. 
C 2 ) Assume that for all n > 1 

L 2 , n (Q) = sup E Q I^^^-E^J] < 



2 

' OO . 



M<l,#(aO<n 



As is shown in the proof of Theorem 13.21 in Section [5] , both Con- 
ditions Cj) and C 2 ) hold for the process (|2.1]h Further we define a 
class of weighted least squares estimates for S(t) as 

oo 

s 7 = ^2-r(J)o jtn ^, (3-6) 

3=1 

where 7 = (7(j))j>i ^ s a sequence of weight coefficients such that 

< 7(j) < 1 and < #(7) < n . (3.7) 

Let T denote a finite set of weight sequences 7 = (7(j))j>i with these 
properties, v = card(r) be its cardinal number and 

fi = max #(7) . (3.8) 

The model selection procedure for the unknown function S in (jl.lj) 
will be constructed on the basis of a family of estimates (S' 7 ) 7Gr . 
The choice of a specific set of weight sequences T is discussed at the 
end of this section. In order to find a proper weight sequence 7 in 
the set r one needs to specify a cost function. When choosing an 
appropriate cost function one can use the following argument. The 
empirical squared error 

Err n(7) = ll&y - SIP 

can be written as 

00 00 00 

Err n ( 7 ) = £ 7 2 (i)^ n - 2 £ j(j)^ n 6 J + £ 0j . ^ 
j=i j=i j=i 

Since the Fourier coefficients (9j)j>i are unknown, the weight coef- 
ficients (7j)j>1 can n °t be determined by minimizing this quantity. 
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To circumvent this difficulty one needs to replace the terms 9j n 8j by 



some their estimators 9^ n . We set 



*i,» = ?,»-^ ( 3 - 10 ) 

where a n is some estimator for the quantity ?q in the condition C x ). 

For this change in the empirical squared error, one has to pay some 
penalty. Thus, one comes to the cost function of the form 

oo oo 

Ul) = E ^)^,n " 2 E I® hn + P P n{l) (3-11) 
3=1 3=1 

where p is some positive constant, P(j) is the penalty term defined as 

F n (7) = ^^- (3.12) 
n 

In the case, when the value of a in C 1 ) is known, one can take a n = 
and 

P " (7) = ^T~- (3 - 13) 

Substituting the weight coefficients, minimizing the cost function 

7 = argmin 7gr J n (j) , (3.14) 

in (|3.6p leads to the model selection procedure 

S, = S^. (3.15) 

It will be noted that 7 exists, since T is a finite set. If the minimizing 
sequence in (|3.14p 7 is not unique, one can take any minimizer. 

Theorem 3.1. Let Q n be a family of the distributions Q on T>[0,n] 
such that the conditions C-J and C 2 ) hold for each Q from Q n . Then 
for any n > 1 and < p < 1/3, the estimator (|3.15p . for each Q 6 Q n , 
satisfies the oracle inequality 



V, () (S .S) < 1 + l P _ 3 V wmn Q (S^,S) + Ib C) {„.,» C!.K,) 



where the risk 1Zq(-,S) is defined in (|1.4p . 
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1 - 3p 



and 



•«<"■ "> = ^(T^ ' (3 ' 17) 

This theorem is proved in |18j . 



Now we will obtain the oracle inequality for the model (jl.ip . (|2.1D . 
To write down the oracle inequality in this case, one needs the follow- 
ing parameters 

\ = \q\ + (\q 2 ) 2 and A 2 = q\q* + \q\ . (3.18) 

Moreover, we set 

M* = \q\ + ^D* + 80A 2 + 12D* + 21^ (3.19) 

where D* = \\q\ + 1\ 2 q\, = Aq\q* + ^D* + 23A 2 and g 3 = 
XfiEY*. 

Theorem 3.2. Let Q n be a family of the distributions of the process 
(|2.ip with the parameters meeting the conditions (|2.4p . Then, for 
any n > 1 and < p < 1/3, the estimator ()3. 15j) satisfies, for each 
Q G Q n , i/ie oracle inequality (I3.16P u>ii/i 

f (n,p 1 , , 3.20 

Qy ,HJ p* . p(l -3p) v ; 

where 

L* = 2(1 + a maa .(a ma:E + l))g* max . 
Proof of this theorem is given in Section [5j 

Remark 3.1. iVote that the term (|3.20p does not depend on the pa- 
rameters specifying the distribution family Q n . This means that the 
oracle inequality ()3.16j) is uniform over stability region for the process 
(|2.ip including the stability bound, i.e. the case a = 0. 



To obtain the oracle inequality for the robust risks one has to 
impose additional conditions on the distribution family Q n in (|1.6p . 
To this end, we introduce the family of distributions Q onP[0,n] with 
the growth restriction on L x n {Q) + L 2 n (Q), i.e. 

V* = {Q e V n : L 1>n (Q) + L 2>n (Q) < Q , (3.21) 
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where V n denotes the family of all probability measures on £>[0, n], l n 
is a slowly increasing positive function, i.e. l n — > +00 as n — > +00 and 
for any 5 > 

lim % = . 

n-5>oo n" 

In the sequel we use the following condition 

H ) Assume the distribution family Q n is a subset of the class (I3.2ip . 
i-e. Q n CP*, such that 

< := inf QeQn ? g < sup QgQ <r Q := g* < 00 ; 

(3.22) 

CT * : = inf QeQ n < 00 • 



Theorem 3.3. Assume that the family Q n in the robust risk (|1.6p 
satisfies the condition H ). T/ien /or any n > 1 and < p < 1/3, t/ie 
estimator ()3. 15j) satisfies the oracle inequality 



K*(S„S) < 1 + 3P 2 ^ mmK*(S^S) + -B*(n,p) (3.23) 
1 — 3p 7er ' n 



where 



B*(n,p) = V*(n,p) + 6 ^ sup E QS |a n -? Q | 
1 - dp QeQ n 

and 



?*P(1 - 3p) 



3.1 Estimation of <^g 

Now we consider the case of unknown quantity a in the condition C x ). 
One can estimate a as 

n 

B n = J2^j,n with «=[>/nI + l- (3-24) 

3=1 
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Proposition 3.4. Assume that the family distribution Q n satisfies 
the condition H ) and the unknown function S(-) in the model 
is continuously differentiable for < t < 1 such that 

l-Sli = f \S{t)\dt < +oo. (3.25) 



Then, for any n > 1, 



w/iere 



E Qj5 |? n -, Q |<^ 

?e<2„ V n 



where 



So 

n * — ' n ''" ' ' \/n >■- ■ • n •* 

3=1 



CO 



(3.26) 



n i/4 n 1 / 2 
Proof. Substituting ([331) in (I3T241 yields 

i=i v o=i j=i 

Further, denoting 

X 'j = ^-{l<3<n} an< ^ X "j = l{l<j<n} i 

we represent the last term in ()3.27p as 

1 ^ 1 „ , i , 1 „ . „, n — I + 1 

- E^n = " S l,n + ~l=B 2in {x") + 
n L — * J i n > . /n < 



B hn (x) = £ (E QiS " Cq) and B 2> „(x) = £ ^ E Q,4,J 

3=1 3=1 

Combining these equations leads to the inequality 



3>l V 3=1 
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By Lemma [A.3I and the conditions C^), C 2 ), one gets 

2 n 
j>i v 0=1 

n \fn \fn 



In view of the inequality (jl.3p . the last term can be estimated as 



3=1 



n 2 



\ 3 



By applying the inequalities (|3.22p we obtain the upper bound (|3.26p . 
Hence Proposition 13.41 
□ 

Theorem 13.11 and Proposition 13.41 imply the following result. 

Theorem 3.5. Assume that the family distribution Q n satisfies the 
condition H ) and the unknown function S is continuously differ- 
entiable satisfying the condition (13.25p . Then, for any n > 1 and 
< p < 1/3, the model selection procedure ()3. 15[) with the estimator 
(|3.24p satisfies the oracle inequality 

K*(S„S) < 1 \ 3p ~ 2p2 mmK*&,S) + -Btfn,p) , (3.28) 
1 — 3/9 7er ' n 

where 

3.2 Specification of weights in the model se- 
lection procedure ( 13.151 ) 

We will specify the weight coefficients (7(j))j>i in the way proposed 
in |llj for a heteroscedastic discrete time regression model. Consider 
a numerical grid of the form 

A n = {l,...,k*}x{t u ...,t m }, (3.29) 

where ti = is and m = [1/e ]. We assume that both parameters 
k* > 1 and < e < 1 are functions of n, i.e. k* = k*(n) and e = s{n), 
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such that 

k*(n) 

lim^^ k*(n) = +00 , lim^^ = , 

lnn (3.30) 

lim n _^. 00 e(n) = and lim n _ >oc n 5 e(n) = +00 

for any 5 > 0. One can take, for example, 

1 



£ ( n ) = n — and k *( n ) = VMp + 1) • 

m(n + 1) 

For each a = G A n , we introduce the weight sequence r ) a = 

(laU))j>i gi ven as 

laU) = hl^jo} + (l - 0'M) /3 ) l{i <i<w a } (3-31) 
where j = j (a) = [w a /lnn], 

We set 

r = { 7al a€^}. (3.32) 
It will be noted that in this case v = k*m. 

Remark 3.2. It will be observed that the specific form of weights 
(|3.3ip was proposed by Pinsker for the filtration problem with 
known smoothness of regression function observed with an additive 
gaussian white noise in the continuous time. Nussbaum f23f used 
these weights for the gaussian regression estimation problem in dis- 
crete time. 

The minimal mean square risk, called the Pinsker constant, is pro- 
vided by the weight least squares estimate with the weights where the 
index a depends on the smoothness order of the function S. In this 
case the smoothness order is unknown and, instead of one estimate, 
one has to use a whole family of estimates containing in particular the 
optimal one. 

The problem is to study the properties of the whole class of esti- 
mates. Below we derive an oracle inequality for this class which yields 
the best mean square risk up to a multiplicative and additive constants 
provided that the the smoothness of the unknown function S is not 
available. Moreover, it will be shown that the multiplicative constant 
tends to unity and the additive one vanishes as n — >■ 00 with the rate 
higher than any minimax rate. 
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In view of the assumptions (|3.30p . for any 5 > 0, one has 



v 

lim -f = . 

ra-i-oo n° 

Moreover, by (|3.3ip for any a G JC n 

oo 

Yl 1 {7 Q (i)>0} ^ 

i=i 

Therefore, taking into account that Ap < A\ < 1 for /3 > 1, we get 
Therefore, for any 5 > 0, 

lim ht|-t=0. 

To study the asymptotic behaviour of the term B*(n,p) we assume 
that the parameter p in the cost function (|3.11[) depends on n, i.e. 
p = p n such that p n — >• as n — >• oo and for any (5 > 



71— »0O 



lim nV„ = . (3.33) 



Applying this limiting relation to the analysis of the asymptotic 
behavior of the additive term T> n (p) in (13.28P one comes to the follow- 
ing result. 

Theorem 3.6. Assume that the family distribution Q n satisfies the 
condition H ) and the unknown function S is continuously differen- 
tiable satisfying the condition (I3.25p . Then, for any n>l, the model 
selection procedure (|3.15p . f|3.33j) . (|3.24p . (|3.32p satisfies the oracle in- 
equality (I3.28P with the additive term B^(n,p) obeying, for any 5 > 0, 
the following limiting relation 

BUn, p n ) 
lim lV / nJ = . 

n->oo n° 
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4 Stochastic integrals with respect to 



the process (12.11 ) 



In this Section we establish some properties of a stochastic integral 



h(f)= f fs^s 0<t<n, (4.1) 
Jo 

with respect to to the process (|2. 1 j) . We will need some notations. Let 
us denote ^ 

£f (t) = a[ e°(*-^ f(v) (1 + e 2av ) dv , (4.2) 



o 

where / is [0, +oo) —> R function integrated on any finite interval. We 
introduce also the following transformation 

Tf, g (t) = l -f (2f(s)g{s) + e* fg (s)) ds (4.3) 
« o 

of square integrable [0, +oo) — > R functions / and g. Here 

E* ftg (t) = f(t)e g (t) + e f (t)g(t). 
It will be noted that 

ar f>1 (t) = i £/ (t) and ar^t) = ~ (e 2at - l) . (4.4) 

Proposition 4.1. // / and g are from C 2 [0, n] then 

EI t (f)I t (g) = Q *T f Jt) (4.5) 
where g* is given in (|2.4p . 

Proof. Noting that the process I t (f) satisfies the stochastic equation 

dJ t (/) = af{t)i t dt + f(t)du t , I (f) = , 

and applying the Ito formula one obtains (|4.5p . Hence Proposition [57TJ 
□ 

Further, for integrated [0, +oo) — > R functions / and g, we define the 
[0, +oo) x [0, +oo) -)• R function 

X 







D fjg (x,z)= I L* ftg (y,z)dy + f(z)g(z), (4.6) 
15 



where L* g (y, z) = g(y + z)L f (y, z) + f(y + z)L g (y, z); 

L f (x, z) = ae ax (f(z) + a f e av f{v + z)dv\ . 



o 



Proposition 4.2. Let Q k = cr{T 1 , . . . ,T k }, where k > 1, be a-algebra 
generated by the stopping times (|2,3p . / and g be bounded left- continuous 
[0,oo) x £2 — > E functions measurable with respect to B[0, +oo) (g) Q k 
(the product a algebra created by ,B[0,+oo) and G k ). Then 

v(i Tk M)\Gk) =o 

and 

k-l 

e (i Tk M) h k -{9)\Qh) = Qh, g (T k ) + qIJ2 D f>g (T k - r„r,) . 

1=1 

Proof. By the Ito formula one has 



W)I t {g)= / (g 2 1 f(s)g(s) + a(f(s)I s (g)+g(s)I s (f))Qds 

+ QlY,f( T i)9(T l )Y l 2 l {Ti < t} 

i>i 

+ f (f(s)I s _(9) + g(s)I s M)))du s . (4.7) 
Jo 

Taking the conditional expectation E (-\G k ), on the set {T k > t}, yields 
E (!,(/) I t (g)\g k ) = ! Q\f{s)g{s)ds + e 2 2 £ f^g^) l {T; < i} 

+ a f (f(s)B(i s (g)ag k )+g(smi s (m s \g k ))ds. 

Jo 

Now to calculate the function Z t = E(I t (f)^ t \G k ) we put g = 1. Taking 
into account that 

m 2 t \Q k ) = f a (e 2at - 1) + ^ E e2a(t " Ti) Ht^} > 
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one obtains, for < t < T-, 

4 = aZ t + f(t)il>t , 

where 

^ = |(l + e^) + ^E e2a(t " Ti)l W<*}- 
Therefore, for T J _ 1 <t<T j; 

Z t = e^- T ^Z T . + /** e a (*- s )/( S )^d S . 

^From here and (|4.6p with g = 1 one has 

=e a(T ^ T ^ ) ^ T ._ 1 +r/ j , Z To = Z = 0, (4.8) 

where 

rT 4 



Vj= I 3 e^-^fis^ds + elf^). 
Solving the equation (|4.7j) one obtains 

Z T = [ Tj e^f(s)^ds + l Y.e^-^m) 
Jo 



Therefore, 



J o i>i 

i.c 

dE(I t (f)Z t \g k ) = Q ^e f (t) + e l Y, L f (t-T ]: T 3 )l {T ^ t y 

^From here one comes to the desired equality. Hence Proposition 14.21 
□ 

Proposition 4.3. Let F , f and g be non random bounded left- continuous 
[0, oo) — > R functions. Then 



Vj2HT k )I Tk U)I Tk (5)l { T fc <t}= f F{v)H f j 
k>i J o 



v) dv , 
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where 



H f Jt) = \glT f Jt) + (Xg 2 ) 2 [ D f>g (t-z,z)dz. 



o 



Proof. We have 



v(t) = E ]T F(T k )I Tu _(f)I Tk _(g) l {Tfe < t} 
fe>i 



By Proposition 14.21 one gets 

i(t) = qIE £ F(T k )r f jT k ) l {Tfc < t} 



fc>l 

fe-l 



fe>l 1=1 
■= h(t) + h(t) , 

where 



l>l 

To calculate i 2 (t) we note that 



, 2 (t) = E^l {Ti < t} £ F(T k )Dj g {T k — I), TJ)l{ Tfc < t } . 
i>l fc>«+l 

Taking into account that T k — T t is independent of TJ for any k > I we 
obtain 

rt-T. /wNfc-Z-l 



i2 (t) = AE^l {T; < 4} ' £ Fiz + TjDtoM) ( f Z ]~_\ v e- Xz dz 
l>i J ° k>i+i K '' 

= AE^l {T; < t} f T ' Fiz + TjD^Tjdz 
i>i J ° 

ft rt—x 

= A 2 / / (F(z + x) D f g (z, x)dz) dx . 



o J o 
□ 
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Note that 

aH L1 (t) = h s f (t) and aH 1A (t) = ^ {e 2at - l) , (4.9) 

where A x given in (13. 18H . Now we set 

/*(/) = / t 2 (/)-E/ t 2 (/). (4.10) 

Further we need the following correlation measures for two integrated 
[0, +oo) — > R functions / and g 

w fn = max max I / f (u + v)q(u)du\ (4.11) 

/,S 0<v<n 0<t<n-v J Q V ' 

and 

zu* Lg = max (w f g ,zu g f ) . (4.12) 

For any bounded [0, oo) — > 1R function / we introduce the following 
uniform norm 

ll/ll*= sup |/(t)| . 

0<t<n 

To check the condition C 2 ) one needs the following non-asymptotic 
upper bound 

Theorem 4.4. For any bounded left- continuous [0, oo) — > M functions 
f, 9 

\EI n (fK(9)\ < nM* (™* g + \\fU\g\l) ll/ILNI* . (4-13) 
where M* is defined in (|3.19p . 

Proof. By the Ito formula one comes to the following stochastic 
equation 

dl t (f) = 2av t (f)f(t)dt + dM t (f) , J (/) = , 

withv t (f) = i t (m t -Ei t (f)c t , 

dM t (f) = 2I t _(f)f(t)du t + Q 2 2 f 2 {t)dm t , M (/) = 0. 
In view of Propositions 14. 1H4.3|. one finds 

B[I(f)J(g)] t = -E[M(f),M(g)] t = [ V f>g (s)ds, (4.14) 
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where V f>g (t) = 4f(t)g(t)G f Jt) +03 f(t)g 2 (t) & ndG f>g = Q 2 ie *T f Jt)+ 
g^Hf g(t), Note that Lemma |A. II implies 

max \G f (t)\ < (Ag 2 lQ * + g 2 2 Bl)w* (4.15) 

0<t<n J,y J ' 9 



One can easily check that 

V x ,{t) = 2X 2 - - + g 3 . (4.16) 



e 2at _ 1 



The constants A 2 , g 3 and D* are given in (|3.18|) - (|3.19p . Moreover, by 
the Ito formula we get 

dv t (f) = av t (f)dt + af(t)( t dt + dK t (f) , «„(/) = , 

where Ct = #-E#, 

K t (f) = [ !*_(/) du s + f elf(s)dm s (4.17) 

with 

0<s<t 

Proposition 14.11 implies 

E/;(/)/ t *( 5 ) = ^r; 5 (t), 

where 

r /V*) = T /,^) + /(*H a (*) + ^(t)r/,i(t) + /(*)<?(*) ^(i) . 
iFrom (fO |> -(fO ]| it follows that 

^(i) = r f>g (t) + J* . (4.18) 



By applying Proposition 14.31 one finds 



fe>i 

where 



E E4 fc J/)4 fc _(5)i { T fe < t} = f H* g 

J 



» dv , 



ffi (t) = H f Jt) + f(t)H ltg (t) + g{t)Hf,i(f) + • 
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/,From here and (|4.9p we get 



e* (t) + f(t)g(t){e 2at - 1) 

Taking this into account, we calculate that, for any square integrated 
functions / and g, 

E [K (/) , K(g)] t = J* (G* f g (s) + g 3 f(s) g(s) ) ds , (4.20) 

where 

Further by applying Propositions I4.1H4.3I we obtain 

E[K(f),M(g)] t = fl/^OOds, (4.21) 

where 

C/ /i9 ( S ) = 2 5 ( S )G /jg ( S ) + 2g(s)f(s)G ljg (s) + £ 3 / (*)s 2 (s) • 
By the Ito formula one finds for t > 

BI t (f)I t (g) = E [/(/), 7( 5 )] t + 2 T (/(*)7}» + «/(*) 7^») ds, 

(4.22) 

where Tf g (t) = aEv t (f) I t (g)- Since for g = 1 the processes I t {g) and 
v t (g) coincide with ( t , i.e. I t (l) = v t (l) = ( t , (|4.17p implies 

EC , = £ eM ts) y l l{s)ds = e ^_h±^ + e ^h + ^_h_pi . 

(4.23) 

We define the function 

A f (t) = f e 3a ^ (f(s)a 2 E C 2 + n f (s)) ds , (4.24) 

where 

n f (t) = A 2 (e f (t) + f(t) (e 2at - 1)) + ag 3 f(t) . 

Denote 

V f Js) = A* g (s) + G* fg (s) + £ 3 f(s)g(s) , (4.25) 
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where A* g (t) = g(s)A f (s) + f(s)A g (s). 

To calculate the function 7~f g (t), we note that, by the Ito formula and 
gH]), 

dE^(/)/,( 9 )=a(E^(/)7,( 5 ))dt + 2a 5 (t)(E^(/)^( 5 ))dt 

+ af(t)(E( t I t (g))dt + U f>g (t)dt . (4.26) 
Substituting here / = 1, and then taking into account (|A.2p yield 

ECJt(g) = £ e 2a( *- s) (a; 9 ( s ) + u u (s)) d S . 

Furthermore, by (|A.2|) 

Ew t (/)I t (s) = 2a /"* e a ^g(s) (Ev s (f)v s (g)) ds 
Jo 

+ a f e a ^f(s) (ECj s (g)) ds + f e a ^ U Lg (s)ds . 
Jo x ' Jo 

Therefore, for any bounded left-continuous [0, +oo) — > M. functions / 
and g, one finds 



Tf*® = a 
where 

and 



f e a ^ {g(s)V Lg (s) + f(s)JC g (s) + U f>g (s)) ds , (4.27) 
Jo 

V f Jt) = 2a f e 2a ^ V fjg (s)ds 
Jn 

KJt) = a 



^From (jlTlTD and (02ZD, it follows that 

\EI n (f)I n (9)\ < n\\V f J, + 2n\\fUT f J* + 2n\\gUT gJ l 
Now by applying the inequality (jA.lOp one gets 

liy^L < ((4^ + Qpl)™* f>g + 3 ll/ll*IMI*) ll/IUNI* ■ 

Note that Lemmas IA.6HA.8l imply 

\\T f Jl < ((20A 2 + 3D 2 *V* ff + 5 e3 ||/|U||a||, 

^From here one comes to the upper bound (|4. 12[) . 
□ 
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5 Proof of Theorem 13.2 



First we note that Proposition 14.11 implies the inequality (jl.3p with 
Oq = 3g*. Therefore due to the conditions (|2.4p one obtains a* = 
3g max . Now we verify Conditions C x ) and C 2 ) for the family of pro- 
cesses (|2.ip satisfying the conditions ()2,4p . To begin with we note 
that 

e q ,4„ = ^ (i + ^Vr^)d,) , 

where 

T» = [" <P 3 (t -v)(l + e 2a ^) dt . 

J v 

If j = 1, one has 

\E Q Mln-e*\<2Q*. (5-1) 
Since for the trigonometric basis (|3.ip for j > 2 



^•(t) ^-(i - v) = cos( 7 ^) + R J cos( 7i (2i - v)) 
where 7^ = 27r[j/2], therefore, 

pn—v 

T.(v) = co S ( 7j v)F(v) + (-iy T 0J .(«) , = / (1 + e 2at ) dt 

and 

pn—v 

T 0>j (v)= / cos(7,(2t + ^))(l + e M )dt. 
Integrating by parts yields 

e 2a(n-v) a 

T o» = 27 . sin K-) + ^2 T i» 

where 

rn— v 

T 1}j (v) = cos(w 7i )(e a(n - ,j) -I) -a e at cos((2t + v)^) dt . 

It is obvious, that |T 1 j(u)| < 2. Further we obtain 

rn i-n i-n 

a / e av Tjivjdv = a e av F(v) coB(irfj)dv + a(-l) j / e av T 0J (v) dv 

Jq Jq Jq 

:= aD^n) + a(-l) j D 2 (n) . 
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Integrating by parts two times we find 

D^n) = (e an F{n) - F(0) - oF(0) - J™ e^F^dvj , 
where 

F x (v) = a 2 F{v) + 2aF(v) + F(v) . 

This implies 

l^iHI < (3n|o| + 10) . 

'3 

Similarly, one gets 

'j 

Thus, for j > 2, 

lip f2 *, ^ 15|o|(l + |a|)e* , . 

\ B Q,stj, n -B\< ^2 • ( 5 - 2 ) 

Therefore 

L ljn (Q)<2(l + |a|(|o| + l))e* 
and taking into account the conditions (|2.4[) we get 

L lin (Q)<L*, (5.3) 

where is defined in (|3,18p . It means that the condition C x ) holds 
with qn = g*. Moreover, by applying the conditions (j2.4j) we have 
<T* = g* and c, = o* . . 
To check the condition C 2 ) we note that 

E Q,S E - Eq i5 ^J = ^ E ^ E Q)5 J n (0JJ n (^) . 

\i=i / »J>1 

Therefore, in view of Theorem 14.41 

(°° \ 2 2M* 

E *i - E «,4J P—E n WK i + 2 ) > 
3=1 J i,3>l 

(5.4) 

where w* . = w*. , . To estimate this term we note, that for any 
4>j(v + u) = dj^v^j^iu) + a 3 -(u)^-(u) + a j+1 (v)4> j+1 (u) 
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Oj(-) are bounded functions with |a,-(u)| < 1. Thus, 

w h - 3rtl {N-il<i> + 31 {N-il>2} • 

Since Yl,j>i x2 j — 1> therefore, the upper bound in (|5.4p can be esti- 
mated as 

\x l \\x j \{wl j + 2)<Un. 

i,j>l 

^From here, it follows that 

L 2>n (Q) < 28M* . (5.5) 

Hence Theorem 13.21 
□ 

6 Robust asymptotic efficiency 

In this Section we show that the model selection procedure (|3.15p . 
(ET33]) . d32H), (ET32]) for estimating S in the model {TT} is asymptot- 
ically efficient with respect to the robust risk (11.61) . We assume that 
the unknown function S in the model (jl.ip belongs to the Sobolev ball 

fe 

K k = {f£ C^'E \\f U) \\ 2 <r}, (6.1) 
i=o 

where r > 0, > 1 are some parameters, C k er [0, 1] is the set of k 
times continuously differentiable functions / : [0, 1] — > K such that 
/W(0) = / (i) (!) f or all < i < k. The functional class W k can be 
written as an ellipsoid in l 2 , i.e. 

oo 

W r = if G X l : E °J ^ ^ ^ ( 6 - 2 ) 

3=1 

wherea J = Eto(2vr[i/2]) 24 . 

We denote by Q the distribution of Winer process with the scale 
parameter defined in (|3,22p , 

H x ) Assume the distribution Q belongs to the family Q n . 
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In this Section we will show that the Pinsker constant for the 
robust risk (|1.6p is given by the equation 

Rl = m + l)r)^ k+l) (j^) • (6.3) 

It is well known that the optimal (minimax) rate for the Sobolev ball 
W k ig n 2fc/(2fc+i) ( se6) for examp i e; [23]^ [23]). 

We will see that asymptotically the robust risk (jl.6p normalized 
by this rate is bounded from below by Rt, i.e. this bound can not be 
diminished if one considers the class of all admissible estimates for S. 
Let II n be the set of all estimators S n measurable with respect to the 
sigma-algebra a{y t , < t < n} generated by the process (jl.ip . 

Theorem 6.1. Under the condition H x ) 

liminf n 2fc /( 2fc+1 ) inf sup K* {S n , S) > R* (6.4) 



Proof of this theorem follows directly from Theorem 3.2 in [19j . 
Now we show that, under some conditions, the normalized robust risk 
for the model selection procedure is bounded from above by the same 
constant R* k . 

Theorem 6.2. Assume that, in model (jl.ip . for each n > 1 the distri- 
bution of (£t)o<t<n belongs to the family Q n satisfying the conditions 
H ). Then the robust risk (ll.6p of the model selection procedure 
defined in (]3.33j) . (|3.24p . (|3.32p has the following asymptotic upper 
bound 

limsup n 2k/i2k+1) sup K* n (S„ S) < R* k . (6.5) 

n^oo SeW? 

Theorem 16.11 and Theorem 16.21 imply the following result 
Corollary 6.3. Under the conditions H ) and H 1 ) 

lim n 2k ^ 2k+1 ^ inf sup K*(S n ,S)=R* (6.6) 



Remark 6.1. The equation (|6,6p means that the parameter R^ de- 
fined by (|6.3p is the Pinsker constant (see, for example, f24tf , JEM) f or 
the model (jl.ip . Moreover, the equality (j6.6p means that the model 
selection procedure (j3.33p . (j3.24p . (j3.32p is asymptotically robust effi- 
cient. 
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7 Upper bound 
7.1 Known smoothness 

First we suppose that the parameters k > 1, r > in (|6.ip and <j* in 
(|3.22p are known. Let the family of admissible weighted least squares 
estimates (£L) 7er for the unknown function S 6 be given by 
(|3.32p . Consider the pair 

"o = (Mo) 

where t = \f/e]e, r = r/q* and e satisfies the conditions in (|3.30p . 
Denote the corresponding weight sequence in T as 



7o = 7« - (7-1) 

Note that for sufficiently large n the pair q belongs to the set (|3.29p . 

Theorem 7.1. The estimator satisfies the following asymptotic 
upper bound 

hmsup n 2fc /( 2fc+1 ) sup n* &.S) < R* k . (7.2) 

n— >oo SeW k 



Proof. Substituting the model (jl.ip in the definition of 0- in ([3T 
yields 

~~ ~7^i' n ' 



where the random variables are defined in (|3.4p . Therefore, by 
the definition of the estimators 5 7 in (|3.6p . we get 

n i n 

us* - *n 2 = E a - 7oO-)) 2 *j - 2M n + i E & 

with 

1 n 

It should be observed that EQ S M n = for any Q 6 Q*. Moreover, 
by the condition C x ) 

n n 
E Q,5 E ^ ? Q E ^o(i) + L l,n(Q) 
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and, taking into account the condition H ), we get 

n n 

sup E QiS £ 7 2 (j) e j>n <?*£ 7 2 (J) + i n • 

Thus, 

n x n , 

KiK' 3 ) ^ E( 1 -7o(j)) 2 ^ 2 + ^E7o 2 a) + ^ (7.3) 

3=1-0 J =1 

where t = j ( a o)- Setting 

„„ = „»/(»+!) aup(l-7o(j)) 2 /ai, 
i><-o 

we estimate the first summand in the right-hand of (IT. 3f) as 

n 

^From here and (|6.2p . we obtain that for each S G VF fc 



T ljn (5) = n^ + D £(l- 7o(i )) 2 0| < 



Further we note that 



limsup (r) 2fc /( 2fc+1 ) t; n < 



^ (Tfc) 2fc/(2fc+l) ' 

where the coefficient r k is given in ()3.3ip . Therefore, 

limsup sup T l n (5) < ( ? *) 2fc /( 2fc+1 ) T* (7.4) 



where 

T 



r l/(2fc+l) 



1 n 2k( T \2k/(2k+l) ' 

To examine the second summand in the right hand of (|7.2p . we set 

1 n 

^ 2 :« = n l/(2fe+l) E ^0 C?) • 
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It is easy to check that 

(f)V(2fc+i) 2 > n (k + l)(2fc + 1) " 2 
Therefore, taking into account that 

^*^2fc/(2fc+l) j* _|_ ? *^l/(2fc+l)Y* _ 

we obtain 

lim n 2fc /( 2fc+1 ) sup ft* (SL , 5) < i2* 



To' 

sew* 



Hence Theorem 17.11 □ 



7.2 Unknown smoothness 

Combining Theorem 17.11 and Theorem 13.61 yields Theorem 
□ 



8 Appendix 

A.l Technical lemmas 

Lemma A.l. The operators Tt g and Hf g satisfy the following in- 
equalities 

sup \r f Jt)\ <4ro* and sup \H f Jt)\ < D*ro* (A.l) 

0<t<n J ' a 0<t<n J ' a 

where D* is given in (|3,19p . 
Proof. Fist note that 

ft ft / ft-V 



J f(s)e g (s)ds = aj e™^ f(s + v)g(s)(l + e 2as )^ j dv . 
Integrating by parts yields 

f " f( s + v)g(s)(l + e 2as )ds = (l + e 2a ^) f * f(s + v)g{s)ds 
Jo Jo 

-Zajy e 2as (J* f{z + v)g(z)dz S j ds . 
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Taking into account the definition (|4.1ip . we estimate this integral as 



f " f(s + v)g(s)(l+e 2as )ds 
Jn 



< 3w* g . 



Therefore, 



f(s)e g (s)ds 



< 3rot and 

— 1,9 



e* fg {s)ds 



< 6zu 



f,9 ■ 



This implies the first inequality in (jA.ip . To obtain the second one we 
represent the function Hj- g (t) in the following form 

Jo 

+ ^«»( f) + <( t) + 0) + <w), 



where 



H gJ® = a f f 2 e a yg(y + z)f(z)dydz 
Jo Jo 



and 



/ f e ay g(y + z) F e av f(v + z) dv dy dz . 
Jo Jo Jo 



Now we note 



Km 



t-y 



g(y + z)f(z)dz dy 



< w 



f,9 • 



(2) 

To estimate H j-(t) we represent it as 



2 / „ay I I „ai> 



-'o wo 



5(2/ + + z )& z )dv)dy 







Note that for any < v < y < t one has 
rt-y 

g(y + z)f(v + z)dz 



^ 2w h ■ 



(2) 

Thus, \H g j(t)\ < 2m* g , and we come to the second inequality in 
(jA.ip . Hence Lemma lA.li 
□ 
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Lemma A. 2. For any bounded left- continuous [0, +00) —> R functions 
f, 9 

Bv t (f)v t (g)= f e 2a{t - s) V Lg (s) ds , 

where Vf >g (s) is given in ()4.20j) . 

Proof. By the Ito formula and (|4.15j) . one gets 

dEv t (f)v t (g) = 2aEv t (f)v t (g)dt + (G* fg (t) + g 3 f(t)g(t))dt 
+ a(g(t)Ev t (f)C t + fmv t (g)Qdt. 

To calculate Ev t (f)Q, we put g = 1 in this equality. Then, taking 
into account that 

K f (t) = aG* f l {t) + ag 3 f(t) , 

we get 

aEv t (f) Ct = f e 3 ^- s > (/(s)a 2 E C s 2 + n f (s)) ds = A f (t) . (A.2) 
Therefore 

Vv t (f)v t (g) = f e 2 ^-*) (g(s)A f (s) + f(s)A g (s)) ds 
Jo 

+ j\Mts) ( G l g (s) + Q 3 f(s)g(s)) ds. 

Hence Lemma lA.21 
□ 

Further we will need the following result. 

Lemma A. 3. Let v be a continuously differentiable R — > R function. 
Then, for any n > 1, a > and for any integrated R — > R function 



sup 

0<<<n 



f 



a( *- s %(s)y(s)d^ 



< ro x ^ 2 u , H ; 

a 



Proof. One obtains this inequality with the help of integrating by 
parts. 

□ 
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Lemma A. 4. For any mesurable bounded [0, +00) — > M functions f 
and g, for any —00 < a < , for any < t < n and for any n > 1 

a f e 2 < t ^g{s)A f {s)ds < 3X 2 m* + 03II/LNI* ■ (A.3) 

Proof. One can represent the function as 

A / (t) = f e 3a{t ~ s ^f{s)v{s)ds + A 2 /" e 3a ^e f {s)ds , (A.4) 



where = a 2 E£ 2 + A 2 (e 2as — l) + ag 3 . /From here and (|4.23jl we 
rewrite this function as 

f(s) = avi(s) + v 2 ( s ) (A-5) 

with 

«i00 = f (^ + 3) and ^) = ^-^. 
These functions can be estimated as 



(A.6) 



< £3; 

Now we represent the intergal in (IA.3j) as 

a T e 2a (*- s ) ds = J x {t) + J 2 (t) + X 2 J 3 (t) , 

Jo 

where 

J^t) = a 2 f e 2a{t ' s) g(s) ( f e 3ais ~ u) f(u) Vl {u)du) ds 



J 2 (t) = a j\ 2a ^ g(s) (J\ 3a ^f(u)v 2 (u)d^J ds . 
J 3 (t) = a y* e 2a (*~ s ) g( s ) (^J S e 3a ^~ u) s f (u)du^ ds . 



In view of ()A.6p we have 



sup IJxC*)! <e 3 ll/IL 

0<t<n 
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Further we represent J 2 (i) as 

J 2 (t) = aj" e 3au U e 2a{t - u ' s) g(s + u)/(sH(s)ds) du. 

By Lemma IA.3I and (|A.6p we obtain that for any < z < n and 

< u < n — z 



e 2a( - z ~ s) v(s)g(s + u)f(s)ds 



— 1 f,9 



Therefore, 



sup \J 2 (t)\ < \ 2 w* f . 

0<t<n 



Similarly, one gets 

2 

sup |J 3 (i)| <-zu* . 

0<t<n 6 1 

To estimate the quantity w , defined in (|4.1ip we note that for any 
< v < n and < t < n — v 

[ g{s + v)e f (s)ds = a f e ax @ g f (t - x,v + x)dx , (A.7) 

where ^ 

e gJ (t,v)= [ g ( s + v )f( s )(l + e 2as )ds. 



Denoting 

T gJ (s,u) = f g(r + u)f(r)dr, (A.f 
we represent the function Q g j(t,v) as 

e gJ (t, v) = (l + e 2at ) T gJ (t, v) - 2a f e 2as T gJ (s, v)ds . 

Jo 



Therefore 



0<u<n 0<t<n-v 

In view of (jA.7|h one gets 



max max \Q g j(t,v)\ < 3w^ . 



w nc < 3w*r and sup |Jo(i)l < 2ro* 
9> £ f - f,g n * f,9 

0<t<n 



Hence Lemma lA.41 
□ 
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Lemma A. 5. For any mesurable bounded [0, +00) — > M functions f 
and g, for any —00 < a < , for any < t < n and for any n > 1 



2a / e 2 ^*- 8 ) G* (s) d* 
•/ n 



^ D 2 W f,9 ' 



(A.9) 



where D* is defined in (|3.19p . 



Proof. First we note that the function G£ can be represented as 

G}Jt) = G f Jt) + £ f /j9 (t) + ^ (e 2 - - 3) /(t)o(t) . 
Integrating by the parts yields 

Finally, by applying Lemma IA.3I with v(s) = e 2as — 3 and ^(s) 
f(s)g{s), one gets 



3 2o(t-«) ( e 2os - 3)/(s) 5 (s) ds 



< 7w* . 

— /,9 



Hence Lemma IA.5I 
□ 

Lemma A. 6. For any mesurable bounded [0, +00) — > M functions f 
and g, for any —00 < a < , /or any < t < n and /or any n > 1 



V/^)|< (6A 2 + D;V* g + 3 e3 ||/||J| 5 |U. 



(A.10) 



Proof. This inequality is a direct consequence of Lemmas IA.2IIA.5l 
Hence Lemma IA.6I 
□ 



Lemma A. 7. For any mesurable bounded [0, +00) — > M functions f 
and g, for any —00 <a<0,0<t<n and n > 1 



a J e a ^f(s))C g ( S )d S 



<14A 2 ||oL^ + £ 3 ||/|U|a|| 2 . (A.ll) 
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Proof. Taking into account (|A.4p - (|A.5p . we write down the function 

A g (t) as 

A g (t)=Af(t) + Af(t) 

where 

f (f) = a fe 3fl (H 5(s)ui(s ) dS) A f\t) = fe^ts) ( g{s ) V2{s ) + X 2 e g (s))ds. 



9 

Since 



2A 

U ll9 (t) = -^g(t)e g (t) + g 3 g 2 (t), 



the integral in (|A.12p can be represented as 

a /V*--) f(s)K g (s)ds = j*(t) + j;(t) + j;(t) + r 4 (t) , 

Jo 



where 





= 2a 2 [ 




Jo 




= 2a 2 [ 




Jo 




= 2aX 2 j 




= 03 a2 i 



3 2 < s -^g(r)Af\r)dr ) ds , 



S e 2a ^g(r)eJr)dr)ds. 



In view of (1A.6h . one obtains 

sup \A<»(t)\<%\\g\U and sup |J*(i)| < f 

Denoting 

T Lg (t,x) = f e a ^Af{s)f{s + x)g{s)d t 
Jo 

one has 



pt—x 

J*(t) = 2a 2 / e 2ax T Lg (t - x, x) dx . 
Jo 
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Noting that 

sup \v 2 (t)\ < -± , 

0<t<n L 

one comes to the inequalities 

r\ 

sup \Af{t)\ < -r±\\g\l and sup < 4A 2 \\g\\, . 

0<t<n D| a l 0<*<n 

By applying Lemma [A.3I with \£(s) = f(s + x)g(s) and v(s) = v 2 (s) 
one gets 

17 

sup sup |r /)ff (t - x,x)\ < -pr A 2 zu; < 6A 2 ro* Hffd* • 

0<(<n 0<i<i 

Therefore, 

sup | J* (t)\ < 6\ 2 w* f \\g\li, . 

0<t<n 

Similarly, one can show that 

sup I J*{t)\ < 8 A 2 wZ \\g\\* ■ 

0<t<n 

Finally, the function J^it) can be estimated as 

«up |J 4 *(*)|<f ll/ll* Ml 

0<t<n z 

Hence Lemma IA.7I 
□ 



Lemma A. 8. For any measurable bounded [0, +oo) — > M. functions f 
and g, — oo < a < 0, < t < n and n > 1 



2 a( *- S) [/ /j5 (s)d.< 

Proof. We note that 



< 2D; \\g\lwl g + q 3 



(A.12) 



= 2g(t)G f>g (t) + ^/(t) 5 (t)e p (i) + ft /(t) 5 2 (t) . 
Taking into account (jA.lOj) we obtain that 



2a f e a ^g{s)G f ^ S )ds 



< 2(4qIq* + Q 2 T>l)\\g\lm* f 



f,g 
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In view of Lemma IA.31 we obtain 



sup 

0<t<n 



z a ^f(s)g(s)eJs)ds 



<tJ7* 2||eJL + 



~g\\* 



f,9 \ " 9 "* 



Taking into account that 

< 2[|fl[|* and ¥g\\* < 4 l a lll3ll* > 

one gets 



sup 

0<t<n 



^ t - s) f(s)g(s)eJs)ds 



o 



f,9 ' 



^From here we come to desired result. Hence lemma |A. 81 
□ 



A. 2 Property of the Fourier coefficients 

Lemma A. 9. Suppose that the function S in (11.11) is differentiable 
and satisfies the condition (|3,25p . Then the Fourier coefficients (|3.2p 
satisfy the inequality 

oo 

sup* W < 4 |^|2. 

l>2 , 



Proof. In view of (|3.ip . one has 



1 



7 2p 



S(t) sin(2vrpt)dt 



and 



1 



7 2p+l 



V27Tp jq 

= _V2 r 1 

/,From here, it follows that for any j > 2 



S(t) (cos(27rpt) - l)d* 
S(t) sin 2 (vrpt)dt, p>l. 



Taking into account that 



sup/^1 < 2. 
we arrive at the desired result. □ 
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